Intrusion detection system, intrusion detection method, and computer-readable medium

ABSTRACT

The conventional image surveillance technologies relevant to the present invention had the potential of failing in detect ion due to the intrusion duration time being set too long and thereby allowing an intruder to pass a warning line before the preset intrusion duration had elapsed. The intrusion detection device according to the present invention is provided with: a detect ion means that detects, in an image, an intrusion position in a specific region by an object that has intruded into the specific region; and a control means that associates the intrusion position with a prescribed time period, wherein the detection means outputs an alert when the object, in the image, has stayed in the specific region for the prescribed time period or longer.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.15/778,334, filed May 23, 2018, which is a National Stage ofInternational Application No. PCT/JP2016/087649 filed Dec. 16, 2016,claiming priority based on Japanese Patent Application No. 2015-245497,filed Dec. 16, 2015, the disclosure of which is incorporated herein inits entirety by reference.

TECHNICAL FIELD

The present invention relates to an image surveillance technique and inparticular to an intrusion detection technique.

BACKGROUND ART

In order to realize a safe and secure society, surveillance cameras havebeen actively installed in cities and buildings. While places to bemonitored increase in this manner, manual surveillance is limited, andtherefore a method for efficiently confirming an image captured by asurveillance camera has been demanded. One method for realizingefficient surveillance is an image surveillance technique fordetecting/recognizing an object appearing on a surveillance camera, andoutputting an alert when the object is a monitoring target. PatentLiterature (PTL) 1 to PTL 3 describe an example of such a technique.

The image surveillance technique includes, for example, a warning linetechnique for detecting an object that has passed a line on an image,and a warning region technique for detecting an object that has intrudedinto a specific region on an image. FIG. 5 represents an example of thewarning line technique. In this example, an object that passes a linesegment connecting a wall and a wall on an image is detected, and awarning is output when the object is a monitoring target. The linesegment may be referred to as a warning line. FIG. 6 represents anexample of the warning region technique. In this example, an object thatintrudes into a specific region on an image is detected, and a warningis output when the object is a monitoring target. The specific regionmay be referred to as a warning region.

Even when it is detected by the warning line technique or the warningregion technique that a monitoring target pass, a response to themonitoring target may be delayed. Thus, in order to early detect themonitoring target, an auxiliary warning region is frequently settogether. The auxiliary warning region is used to detect the monitoringtarget approaching a warning line or a warning region before detectingthat the monitoring target pass. The auxiliary warning region is set ina wide range including the warning line or the warning region. A warningis output when, after an object that has intruded into the auxiliarywarning region is detected as a monitoring target, the monitoring targetstays in the auxiliary warning region for a predetermined time period orlonger. The predetermined time period may be referred to as an intrusionduration time. The auxiliary warning region is limited within animage-capturing region. Therefore, the auxiliary warning regionfrequently has a complex shape in conformity to the image-capturingrange or a shape of a field site.

CITATION LIST Patent Literature

[PTL 1] Japanese Laid-open Patent Publication No. 2008-225803

[PTL 2] Japanese Laid-open Patent Publication No. 2012-058880

[PTL 3] Japanese Laid-open Patent Publication No. 2010-102511

SUMMARY OF INVENTION Technical Problem

In the above-described image surveillance technique, it has beenpossible to set only one intrusion duration time for the auxiliarywarning region. Further, the intrusion duration time does not depend onan intrusion position of an object. Therefore, the set intrusionduration time has been sometimes excessively long for the intrusionposition of the object into the auxiliary warning region. In otherwords, before a warning is output due to a fact that time elapsed fromdetection of intrusion into the auxiliary warning region is equal to orlonger than the intrusion duration time, the object has intruded intothe warning region in some cases. FIG. 7 represents an example of theauxiliary warning region. In this example, an object that intrudes intoa specific region on an image is detected, and a warning is output whenthe object is a monitoring target. The specific region may be referredto as the auxiliary warning region. In FIG. 7, routes i and iiconnecting the warning line and the auxiliary warning region aredifferent in real distance. When, for example, assuming the route ii,the intrusion duration time is set for the auxiliary warning region, anobject that has intruded via the route i having a shorter real distancethan a real distance of the route ii may intrude into the warning regionbefore the set intrusion duration time elapses.

An object of the present invention is to provide an intrusion detectiondevice capable of performing image surveillance depending on anintrusion position where an object intrudes into a specific region on animage, a setting assistance device, an intrusion detection method, asetting assistance method, and a program recording medium.

Solution to Problem

An intrusion detection device of the present invention includes:

a detection unit that detects an intrusion position on an image, theintrusion position being where an object intrudes into a specific regionon the image; and

a control unit that associates the intrusion position on the image witha predetermined time period,

wherein the detection unit outputs an alert when the object stays in thespecific region on the image for the predetermined time period orlonger, the predetermined time period is associated with the detectedintrusion position.

An intrusion detection method of the present invention includes:

detecting an intrusion position on an image, the intrusion positionbeing where an object intrudes into a specific region on the image;

associating the intrusion position with a predetermined time period; and

outputting an alert when the object stays in the specific region on theimage for the predetermined time period or longer, the predeterminedtime period is associated with the detected intrusion position.

In a computer-readable program recording medium of the presentinvention, a program recorded in the computer-readable program recordingmedium of the present invention causes a computer to function as:

a detection unit that detects an intrusion position on an image, theintrusion position being where an object intrudes into a specific regionon the image; and

a control unit that associates the intrusion position on the image witha predetermined time period,

wherein the detection unit outputs an alert when the object stays in thespecific region on the image for the predetermined time period orlonger, the predetermined time period is associated with the detectedintrusion position.

A setting assistance device of the present invention includes: anacquisition unit that acquires coordinates designated by a user for animage capturing a three-dimensional space;

a calculation unit that calculates coordinates of a position located ata predetermined distance from a position of a part of thethree-dimensional space relating to the acquired coordinates; and

a determination unit that determines a region set for the acquiredcoordinates based on the calculated coordinates.

A setting assistance method of the present invention includes:

acquiring coordinates designated by a user for an image capturing athree-dimensional space;

calculating coordinates of a position located at a predetermineddistance from a position of a part of the three-dimensional spacerelating to the acquired coordinates; and

determining a region set for the acquired coordinates based on thecalculated coordinates.

In a computer-readable program recording medium of the presentinvention, a program recorded in the computer-readable program recordingmedium causes a computer to execute:

acquiring coordinates designated by a user for an image capturing athree-dimensional space;

calculating coordinates of a position located at a predetermineddistance from a position of a part of the three-dimensional spacerelating to the acquired coordinates; and

determining a region set for the acquired coordinates based on thecalculated coordinates.

Advantageous Effects of Invention

According to the intrusion detection device, the setting assistancedevice, the intrusion detection method, the setting assistance method,and the program recording medium of the present invention, imagesurveillance can be performed depending on an intrusion position wherean object intrudes into a specific region on an image.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating one example of unit to set anauxiliary warning region according to a first example embodiment of thepresent invention.

FIG. 2 is a block diagram illustrating one example of unit to set anauxiliary warning region according to a second example embodiment of thepresent invention.

FIG. 3 is a block diagram illustrating one example of unit to set anauxiliary warning region according to a third example embodiment of thepresent invention.

FIG. 4 is a block diagram illustrating one example of unit to set anauxiliary warning region according to a fourth example embodiment of thepresent invention.

FIG. 5 represents an example of a warning line technique.

FIG. 6 represents an example of a warning region technique.

FIG. 7 represents an example of an auxiliary warning region.

FIG. 8 is a block diagram illustrating one example of a hardwareconfiguration of a computer that realizes an intrusion detection deviceaccording to the first example embodiment of the present invention.

FIG. 9 is a block diagram illustrating one example of a configuration ofa setting assistance device according to a fifth example embodiment ofthe present invention.

FIG. 10A is a first schematic diagram for illustrating coordinatescalculated by a calculation unit.

FIG. 10B is a second schematic diagram for illustrating coordinatescalculated by the calculation unit.

FIG. 10C is a third schematic diagram for illustrating coordinatescalculated by the calculation unit.

FIG. 11 is a flowchart illustrating one example of processing executedby a setting assistance device.

FIG. 12 is a block diagram illustrating one example of a configurationof an intrusion detection system according to a sixth exampleembodiment.

FIG. 13 is a block diagram illustrating one example of a hardwareconfiguration of an information processing device.

FIG. 14 is a flowchart illustrating one example of processing executedby the information processing device.

FIG. 15 is a flowchart illustrating one example of setting processing.

FIG. 16A is a diagram exemplarily illustrating screen transition of asetting screen.

FIG. 16B is another diagram exemplarily illustrating screen transitionof a setting screen.

FIG. 17A is a first diagram exemplarily illustrating a method forcalculating coordinates.

FIG. 17B is a second diagram exemplarily illustrating a method forcalculating coordinates.

FIG. 17C is a third diagram exemplarily illustrating a method forcalculating coordinates.

FIG. 18A is a diagram exemplarily illustrating a first auxiliary warningregion.

FIG. 18B is a diagram exemplarily illustrating a second auxiliarywarning region.

FIG. 19 is a diagram exemplarily illustrating a third auxiliary warningregion.

FIG. 20 is a diagram exemplarily illustrating a fourth auxiliary warningregion.

FIG. 21 is a flowchart illustrating one example of detection processingand reporting processing.

FIG. 22 is a diagram exemplarily illustrating fifth and sixth auxiliarywarning regions.

DESCRIPTION OF EMBODIMENTS

With reference to the drawings, example embodiments of the presentinvention will be described in detail below. Note that, in the followingdescription, a component including the same function is assigned withthe same reference sign, and description thereof may be omitted.

First Example Embodiment

(Configuration)

FIG. 1 is a block diagram illustrating one example of unit to set anauxiliary warning region according to a first example embodiment of thepresent invention. In the present example embodiment, an intrusiondetection device 1 includes detection unit 2 and control unit 3.

(Operation)

The detection unit 2 detects an intrusion position in a specific region(auxiliary warning region) on an image by an object having intruded intothe specific region (auxiliary warning region). The control unit 3associates the intrusion position on the image with a predetermined timeperiod (intrusion duration time). Further, the detection unit 2 outputsan alert to an operator when the object has stayed in the specificregion (auxiliary warning region) on the image for the predeterminedtime period (intrusion duration time) or longer associated with theintrusion position detected by the detection unit 2. The predeterminedtime period referred to here is a time period determined for eachposition on an image and is defined, for example, by an operator.

For more detail, the detection unit 2 detects an object having intrudedinto the auxiliary warning region and identifies, if the object is amonitoring target, the intrusion position of the monitoring target intothe auxiliary warning region. Further, the detection unit 2 outputs analert to an operator when the monitoring target has stayed in theauxiliary warning region for the predetermined time period (intrusionduration time) or longer associated with the identified intrusionposition. The control unit 3 associates the position on an image withthe predetermined time period (intrusion duration time) and transmitssets of the associated position and the predetermined time period(intrusion duration time) to the detection unit 2. The detection unit 2outputs an alert to an operator based on the intrusion duration time ofa set in which the intrusion position identified by the detection unit 2and the position associated by the control unit 3 are matched among thereceived sets. Alternatively, the detection unit 2 may output the alertto an object having intruded into the auxiliary warning region. Thecontrol unit 3 may perform association, for example, at every fixedtime. Alternatively, the control unit 3 may perform association when thedetection unit 2 makes a request. Further, the control unit 3 may storea set of the position and the predetermined time period (intrusionduration time) associated with each other.

(Advantageous Effect)

According to the present example embodiment, image surveillanceaccording to the intrusion position of the object into the specificregion on an image can be performed.

Second Example Embodiment

(Configuration)

FIG. 2 is a block diagram illustrating one example of unit to set theauxiliary warning region according to a second example embodiment of thepresent invention. The intrusion detection device 1 further includesinput unit 4 to accept the intrusion position into the auxiliary warningregion and the predetermined time period, in addition to the detectionunit 2 and the control unit 3.

The input unit 4 is a unit to accept the intrusion position into theauxiliary warning region and the predetermined time period. Theintrusion position represents, for example, coordinates on an image. Theintrusion position is input by being executed in such a way that theinput unit 4 displays an image on a display, accepts writing of a dot orline on the displayed image, and calculates coordinates on the imagefrom the written dot or line. The predetermined time period is input,for example, with a numerical value. The numerical value may be input bya numerical keypad or another input method. A unit of the predeterminedtime period may be seconds or minutes.

The control unit 3 is unit to associate the intrusion position with thepredetermined time period based on the accepted intrusion position andthe accepted predetermined time period. A central processing unit (CPU)executes, for example, a predetermined program and thereby the controlunit 3 may be realized. When, for example, the input unit 4 accepts theintrusion position and the predetermined time period as one set, thecontrol unit 3 may associate the intrusion position and thepredetermined time period accepted as one set. Alternatively, whenaccepting the predetermined time period, the input unit 4 causes anoperator to select the intrusion position that is a target to beassociated with the predetermined time. Then, the control unit 3 mayassociate the selected intrusion position with the acceptedpredetermined time period. Alternatively, the control unit 3 mayassociate the intrusion position with the predetermined time periodbased on input order of the intrusion positions and the predeterminedtime periods. The control unit 3 associates, for example, first input ofthe intrusion position with first input of the predetermined time periodand further associates second input of the intrusion position withsecond input of the predetermined time period.

The control unit 3 transmits a set of the associated intrusion positionand predetermined time period to the detection unit 2. When making aplurality of sets of the associated intrusion position and predeterminedtime period, the control unit 3 may transmit each of the plurality ofsets to the detection unit 2.

The detection unit 2 is unit to identify the intrusion position of amonitoring target into the auxiliary warning region. And the detectionunit 2 is unit to refer to the predetermined time period associated theidentified intrusion position as the intrusion duration time and outputthe alert to an operator when the monitoring target has stayed in theauxiliary warning region for the intrusion duration time or longer. Oneor more sets of the intrusion position and the predetermined time periodassociated with each other in the control unit 3 is transmitted to thedetection unit 2 from the control unit 3. The detection unit 2 may storethe transmitted one or more sets on a storage that is not illustrated.The detection unit 2 can identify the intrusion position of a monitoringtarget into the auxiliary warning region. The detection unit 2 mayidentify a position where a monitoring target crosses a border line ofthe auxiliary warning region as the intrusion position, for example,using the warning line technique. The detection unit 2 retrieves theidentified intrusion position from the one or more sets transmitted fromthe control unit 3. Then, the detection unit 2 refers to thepredetermined time period associated with the retrieved intrusionposition as the intrusion duration time. The detection unit 2 compares atime period in which the monitoring target has stayed in the auxiliarywarning region with the intrusion duration time and outputs the alert toan operator when the monitoring target has stayed for the intrusionduration time or longer.

(Operation)

Next, one example of an operation of the intrusion detection device 1according to the second example embodiment of the present invention willbe described.

The input unit 4 accepts the intrusion position into the auxiliarywarning region and the predetermined time period. The input unit 4transmits the accepted intrusion position and the accepted predeterminedtime period to the control unit 3.

Then, the control unit 3 associates the intrusion position and thepredetermined time period based on the accepted intrusion position andthe accepted predetermined time period. An association method is amethod as described above. The control unit 3 associates the intrusionposition and the predetermined time period and transmits a set of theassociated intrusion position and predetermined time period to thedetection unit 2.

The detection unit 2 identifies the intrusion position of a monitoringtarget into the auxiliary warning region, asynchronously withtransmission of the intrusion position and the predetermined time periodby the control unit 3. This identification may be performed every time apredetermined time period elapses such as every thirty seconds or everyminute.

The detection unit 2 retrieves the identified intrusion position fromone or more sets transmitted from the control unit 3 when detectingintrusion of a monitoring target into the auxiliary warning region oridentifying the intrusion position. Then, the detection unit 2 refers tothe predetermined time period associated with the retrieved intrusionposition as the intrusion duration time. The detection unit 2 compares atime period in which the monitoring target has stayed in the auxiliarywarning region with the intrusion duration time and outputs the alert toan operator when the monitoring target has stayed for the intrusionduration time or longer.

Note that, in the description of the operation, it is explained thatidentification of the intrusion position by the detection unit 2 andtransmission from the control unit 3 to the detection unit 2 areasynchronously performed, but an order of both is not limited to that.When, for example, the intrusion position and the predetermined timeperiod have been transmitted from the control unit 3 to the detectionunit 2, the detection unit 2 may operate in such a way as to startidentifying the intrusion position. Further, when having been able toidentify the intrusion position, the detection unit 2 may operate insuch a way as to cause the control unit 3 to transmit the intrusionposition and the predetermined time period.

(Advantageous Effect)

According to the present example embodiment, image surveillanceaccording to the intrusion position of an object into the specificregion on the image can be performed.

Third Example Embodiment

(Configuration)

FIG. 3 is a block diagram illustrating one example of unit to set theauxiliary warning region according to a third example embodiment of thepresent invention. The intrusion detection device 1 further includes aninput unit 5 to accept the intrusion position into the auxiliary warningregion, in addition to the detection unit 2 and the control unit 3.

(Operation)

The input unit 5 accepts the intrusion position into the auxiliarywarning region. The input unit 5 further transmits the acceptedintrusion position to the control unit 3. The control unit 3 sets apredetermined time period based on the intrusion position.

The setting of the predetermined time period by the control unit 3 canbe executed, for example, by the following method. The control unit 3acquires, for example, a warning line and calculates a shortest distancebetween the acquired warning line and the input intrusion position.Next, the control unit 3 acquires a moving velocity of an object.Thereafter, the predetermined time period is calculated from the movingvelocity of the object acquired by the control unit 3 and the calculatedshortest distance.

The acquisition of the moving velocity of the object by the control unit3 can be executed, for example, by the following method. For example,the control unit 3 accepts a numerical value representing the movingvelocity of the object. Alternatively, the control unit 3 calculates themoving velocity of the object from an image.

The calculation of the predetermined time period by the control unit 3can be executed, for example, by the following method. The control unit3 determines, for example, a value obtained by dividing the shortestdistance calculated by the above-described method by the moving velocitycalculated by the above-described method. Further, the predeterminedtime period may be a value obtained by adding a predetermined value tothe determined value by the control unit 3. Thereby, setting consideringan operation in actual surveillance can be executed.

(Advantageous Effect)

According to the present example embodiment, image surveillanceaccording to the intrusion position of an object into the specificregion on an image can be performed.

Fourth Example Embodiment

(Configuration)

FIG. 4 is a block diagram illustrating one example of unit to set theauxiliary warning region according to a fourth example embodiment of thepresent invention. The intrusion detection device 1 further includes aninput unit 6 to accept the predetermined time period, in addition to thedetection unit 2 and the control unit 3.

(Operation)

The input unit 6 accepts the predetermined time period. The input unit 6further transmits the accepted predetermined time period to the controlunit 3. The control unit 3 sets the specific region (auxiliary warningregion) based on the accepted predetermined time period. The setting ofthe auxiliary warning region by the control unit 3 can be executed, forexample, by the following method. The control unit 3 acquires, forexample, the moving velocity of the object and calculates the movingdistance of the object in the predetermined time period based on theacquired moving velocity of the object and the predetermined timeperiod. Further, the control unit 3 accepts, for example, the warningline, calculates coordinates at the moving distance of the objectcalculated from the accepted warning line as the intrusion position ofthe object, and sets the calculated intrusion position of the object.There may be a plurality of intrusion positions of the object at thattime. A set of the plurality of intrusion positions of the object formsa line segment. This line segment is the auxiliary warning line. Aregion surrounded by the auxiliary warning line is the auxiliary warningregion.

(Advantageous Effect)

According to the present example embodiment, image surveillanceaccording to the intrusion position of the object into the specificregion on an image can be performed. Further, according to the presentexample embodiment, the auxiliary warning line can be generated by thepredetermined time period.

FIG. 8 is a block diagram illustrating one example of a hardwareconfiguration of a computer that realizes the intrusion detection deviceaccording to the first example embodiment of the present invention. Acomputer 600 includes a processor 610, a memory 620, a storage 630, andan interface 640.

The processor 610 is, for example, a central processing unit (CPU). Thememory 620 is equivalent to a main storage device. The storage 630 isequivalent to an auxiliary storage. The storage 630 includes, forexample, a hard disk or a flash memory. Further, the storage 630 mayinclude a reader/writer for a removable recording medium such as anoptical disk and a universal serial bus (USB) flash drive. The interface640 transmits/receives data to/from an external device.

The processor 610 executes a program stored on the memory 620 or thestorage 630 and thereby can function as the detection unit 2 and thecontrol unit 3 of the intrusion detection device 1.

The present invention can provide an intrusion detection method, inaddition to the intrusion detection device. Further, the presentinvention can be provided also with a form including a program forcausing a computer to function as the intrusion detection device and acomputer-readable recording medium (an optical disk, a magnetic disk, ora semiconductor memory) recording the program. Further, the programaccording to the present invention may be downloaded onto a device via anetwork and may cause the device to function as the intrusion detectiondevice.

Fifth Example Embodiment

FIG. 9 is a block diagram illustrating a configuration of a settingassistance device 100 according to a fifth example embodiment of thepresent invention. The setting assistance device 100 is an informationprocessing device for assisting (easing) setting of a region executed bya user based on an image. The setting assistance device 100 includes atleast an acquisition unit 110, a calculation unit 120, and adetermination unit 130. Note that, a hardware configuration of thesetting assistance device 100 may be similar to the configuration of thecomputer 600 exemplarily illustrated in FIG. 8.

The acquisition unit 110 acquires coordinates in an image. Thecoordinates represent a line (a straight line, a curve, or a polygonalline) or a region designated by a user for an image of athree-dimensional space (i.e. an actual space) captured by animage-capture device such as a surveillance camera. Coordinates acquiredby the acquisition unit 110 are represented by a two-dimensionalcoordinate system in which, for example, a predetermined position (anedge point, a center, and the like) of an image is an origin. In thepresent example embodiment, an image captured by an image-capture devicecan be said to be an image having a depth.

The number of coordinates acquired by the acquisition unit 110 is notlimited to a specific number when a line can be defined. When, forexample, a line designated by a user is a line segment, the acquisitionunit 110 may acquire coordinates of an edge point (a start point and anend point) of the line segment. Alternatively, when the line designatedby a user is a polygonal line, the acquisition unit 110 may acquirecoordinates of edge points of a plurality of line segments configuringthe polygonal line. Designation of coordinates is executed via an inputdevice such as a mouse and a touch screen display. When a user manuallydraws a line by using the input device such as the touch screen display,the acquisition unit 110 acquires respective coordinates on the manuallydrawn line.

The calculation unit 120 calculates coordinates of a position located ata predetermined distance from a position in a three-dimensional spacecorresponding to coordinates acquired by the acquisition unit 110. Theposition referred to here is a position on a plane in an actualthree-dimensional space and therefore is different from coordinates in a(two-dimensional) image. For more detail, the calculation unit 120calculates coordinates in an image of a position located at thepredetermined distance from the position in the three-dimensional spaceof the line designated by a user.

FIG. 10A, FIG. 10B, and FIG. 10C each are a schematic diagram forillustrating coordinates calculated by the calculation unit 120. FIG.10A is a diagram exemplarily illustrating a line L1 designated for animage. FIG. 10B is a diagram exemplarily illustrating a line L1 a of thethree-dimensional space corresponding to the line L1 and a line L2 aobtained by connecting positions located at an equal distance from theline L1 a. FIG. 10C is a diagram exemplarily illustrating the line L1and a line L2 on an image corresponding to the line L2 a.

Note that, it is assumed that the images exemplarily illustrated in FIG.10A and FIG. 10C are different in depth in a direction of y1 axis in thefigures. In other words, it is assumed that in the images exemplarilyillustrated in FIG. 10A and FIG. 10C, coordinates having a largercomponent of the y₁ axis represent a farther position. Further, anobject in an image is captured as a smaller image in the image as adistance from an image-capture device increases. The reason is that amagnification of an object in an image is inversely proportional to adistance between the object and the image-capture device. Therefore, inthe images exemplarily illustrated in FIG. 10A and FIG. 10C, even whenobjects have the same size, an object located at coordinates having alarger component of the y₁ axis is captured as a smaller image.

An x₁y₁ coordinate system of FIG. 10A and FIG. 10C is a coordinatesystem (screen coordinate system) defined for an image. Coordinatesbased on this coordinate system, i.e. coordinates on an image are anumerical value indicating a position of each pixel in which a pixel ofa predetermined position of an image is a basis (origin). On the otherhand, an x₂y₂ coordinate system of FIG. 10B is a coordinate system(world coordinate system) corresponding to an actual three-dimensionalspace and is different from the coordinate system of FIG. 10A and FIG.10C. An x₂ axis component and a y₂ axis component in FIG. 10B is, forexample, equivalent to a latitude and a longitude.

The line L2 of FIG. 10C does not have the same shape as in the line L2 aof FIG. 10B. The reason is that in the images indicated by FIG. 10A andFIG. 10C, apparent distortion (deformation) due to a depth differenceoccurs. Therefore, even when being located at an equal distance from theline L1 a in an actual three-dimensional space, the line L2 in the imageis not located at an equal distance from the line L1 in the image. Formore detail, the line L2 has a shorter distance from the line L1 on theimage as a component of the y₁ axis is larger.

The calculation unit 120 calculates coordinates of each point on theline L2 of FIG. 10C by using a predetermined function. This function canbe defined, for example, based on calibration previously executed. Thecalibration referred to here is executed, for example, by disposing areference object having a known size (a bar having a predeterminedlength, a mark having a predetermined size and the like) at a pluralityof positions in a space to be image-captured and associating a size(e.g. the number of pixels) in an image of the reference object with anactual size.

The determination unit 130 determines a region to be set for thecoordinates acquired by the acquisition unit 110 based on thecoordinates calculated by the calculation unit 120. For example, thedetermination unit 130 determines, as a region corresponding to the lineL1, a region (e.g. a region inside the line L2 in FIG. 10C) surroundedby a closed curve represented by the coordinates calculated by thecalculation unit 120. In the following, the region determined by thedetermination unit 130 will be referred to also as a “setting region”.

The determination unit 130 may determine, as a setting region, a regionpartially different from the region surrounded by the closed curverepresented by the coordinates calculated by the calculation unit 120.The determination unit 130 may determine, as a setting region, forexample, a part of the region surrounded by the closed curve representedby the coordinates calculated by the calculation unit 120. In otherwords, the determination unit 130 may set, as a setting region, a regionin which a part of the region surrounded by the closed curve representedby the coordinates calculated by the calculation unit 120 is excluded.At that time, the determination unit 130 may determine a region excludedfrom the setting region based on another piece of information. Theanother piece of information referred to here is, for example,coordinates acquired by the acquisition unit 110, a feature extractedfrom an image, a predetermined rule and the like. Further, thedetermination unit 130 may determine a region excluded from the settingregion based on an operation of a user.

FIG. 11 is a flowchart illustrating processing executed by the settingassistance device 100. In step S11, the acquisition unit 110 acquirescoordinates designated by a user using a line with respect to an imageacquired by capturing a three-dimensional space. At that time, the imageis captured by the image-capture device and is displayed by a displaydevice. A user designates, using the input device such as a mouse,coordinates for the image displayed by the display device. When FIG. 10Ais used as an example, the acquisition unit 110 acquires coordinatesspecifying the line L1 (e.g. a start point and an end point of the lineL1).

In step S12, the calculation unit 120 calculates coordinates of aposition located at a predetermined distance from a position of athree-dimensional space corresponding to a line represented by thecoordinates acquired in step S11. When FIG. 10C is used as an example,the calculation unit 120 calculates respective coordinates on the lineL2 based on the coordinates specifying the line L1.

In step S13, the determination unit 130 determines a setting regionbased on the coordinates calculated in step S12. The determination unit130 determines a setting region in such a way as to include at least apart of a region surrounded by the line L2. When FIG. 10C is used as anexample, the determination unit 130 may determine, as the settingregion, a part or the whole of the region surrounded by the line L2. Thedetermination unit 130 may determine the setting region in such a way asto include not only the region surrounded by the line L2 but alsoanother region, by using another piece of information described above.

As described above, the setting assistance device 100 of the presentexample embodiment includes a configuration that determines the settingregion based on a line designated by a user. A user has only todesignate, based on this configuration, a line when setting the settingregion, and it is unnecessary to input the setting region itself onhis/her own. Therefore, according to the setting assistance device 100of the present example embodiment, it is easy for a user to accuratelyset the setting region for an image having a depth. In other words, thesetting assistance device 100 can assist a setting operation executed bya user.

Sixth Example Embodiment

FIG. 12 is a block diagram illustrating a configuration of an intrusiondetection system 200 according to a sixth example embodiment. Theintrusion detection system 200 is an information processing system fordetecting intrusion of an object. In several forms, the object referredto here is a person such as a suspicious individual. However, the objectreferred to here may be an animal other than a person or may be amovable machine such as an automobile and a robot. In the following, itis assumed that an object detected by the intrusion detection system 200is a person.

The intrusion referred to here refers to an entry that may be illicitamong entries of an object into a specific region. However, in theexample embodiments of the present invention, whether an object havingentered a specific region actually has an illicit purpose is notproblematic. Whether or not an object having entered the specific regionactually has an illicit purpose may be determined, for example, using asystem separate from the intrusion detection system 200 or may bedetermined by a person. In other words, the intrusion detection system200 may be a system for detecting a sign or possibility of intrusion ormay be a system for detecting an entry of an object (regardless ofwhether to be illicit).

The intrusion detection system 200 includes at least an informationprocessing device 210, an image-capture device 220, an input device 230,and a display device 240. A plurality of information processing devices210, a plurality of image-capture devices 220, a plurality of inputdevices 230, and a plurality of display devices 240 may be included inthe intrusion detection system 200. Further, a part or the whole of theinformation processing device 210, the image-capture device 220, theinput device 230, and the display device 240 may be configured as asingle device.

The intrusion detection system 200 may include another configuration, inaddition to the information processing device 210, the image-capturedevice 220, the input device 230, and the display device 240. Theintrusion detection system 200 may include, for example, a device orequipment (a speaker, a siren, a warning light, and the like) forreporting detection of intrusion.

The information processing device 210 detects a person by using animage. Further, the information processing device 210 assists settingexecuted by a user (operator) in order to detect a person. Theinformation processing device 210 is, for example, a computer devicesuch as a personal computer. The information processing device 210 iscommunicably connected to the image-capture device 220, the input device230, and the display device 240. Communication performed by theinformation processing device 210 may be wired or wireless and may beperformed via another device (i.e. indirectly).

The image-capture device 220 captures an image. The image-capture device220 is, for example, a surveillance camera disposed in a given place andcontinuously image-capturing a specific region. The image-capture device220 image-captures a region to be monitored and generates image datarepresenting a image of the region. The image-capture device 220supplies the image data to the information processing device 210.

The input device 230 accepts an operation of a user. The input device230 is, for example, a mouse or a keyboard. Further, the input device230 may be a touch screen display configured integrally with the displaydevice 240. The input device 230 supplies input data representing anoperation of a user to the information processing device 210.

The display device 240 displays an image. The display device 240 is, forexample, a liquid crystal display. The display device 240 displays animage according to image data supplied from the information processingdevice 210. The display device 240 may display an image captured, forexample, by the image-capture device 220. Alternatively, the displaydevice 240 may display a screen (hereinafter, referred to also as a“setting screen”) for executing, by a user, various types of settingsrelating to surveillance. Note that, the intrusion detection system 200may include a display device that displays an image captured by theimage-capture device 220 and another display device that displays asetting screen.

FIG. 13 is a block diagram illustrating a hardware configuration of theinformation processing device 210. The information processing device 210includes a control unit 211, a storage 212, and an interface unit 213.The information processing device 210 is equivalent to one example ofthe setting assistance device 100 described in the fifth exampleembodiment. For more detail, the information processing device 210 canrealize a function equivalent to the setting assistance device 100 byexecuting, by the control unit 211, a predetermined program.

The control unit 211 includes a processor (arithmetic processing device)such as a central processing unit (CPU) and a main memory (mainstorage). The control unit 211 may include a plurality of processors insuch a way as to include, for example, a graphics processing unit (GPU)for image processing in addition to a CPU. The control unit 211 executesa program and realizes several functions relating to detection of aperson.

The storage 212 stores data used in the control unit 211. The storage212 may store, for example, a program executed by the control unit 211.The storage 212 includes a storage device such as a hard disk drive.Further, the storage 212 may include a reader/writer of a removablestorage medium (a memory card or the like) for the informationprocessing device 210. Transmission/reception of data in the informationprocessing device 210 may be executed via this removable storage medium.

The interface 213 transmits/receives data to/from the image-capturedevice 220, the input device 230, the display device 240 and data. Theinterface unit 213 can transmit/receive data in accordance with apredetermined standard such as Universal Serial Bus (USB) andHigh-Definition Multimedia Interface (HDMI). The interface unit 213 mayinclude an interface connected to a network such as the Internet.

A configuration of the intrusion detection system 200 is as describedbelow. The intrusion detection system 200 based on the configurationdetects a person based on an image captured by the image-capture device220. The information processing device 210 executes the followingprocessing as processing relating to detection of a person.

FIG. 14 is a flowchart illustrating an outline of processing executed bythe information processing device 210. The processing executed by theinformation processing device 210 is roughly classified into settingprocessing (step S21), detection processing (step S22), and reportingprocessing (step S23). Note that, it is not always necessary to executedetection processing immediately after setting processing. Settingprocessing is sufficient when being previously executed at least onceand therefore is not processing necessary every time detectionprocessing is executed.

The setting processing is processing of setting the warning line and theauxiliary warning region. The warning line of the present exampleembodiment is a straight line set by an operation of a user. Further,the intrusion detection system 200 based on the configuration detects aperson based on an image captured by the image-capture device 220. Theauxiliary warning region of the present example embodiment is a regionset based on the warning line and is equivalent to one example of thesetting region in the fifth example embodiment. The Setting processingof the present example embodiment includes processing of assistingsetting of the auxiliary region executed by a user.

The detection processing is processing for detecting an entry of aperson into the auxiliary warning region. The detection processing mayfurther include processing for detecting a pass of the warning line by aperson. Further, the detection processing may include processing fordetecting a stay of a person in the auxiliary warning region, i.e. acontinued stay of a person in the auxiliary warning region for apredetermined time period or longer. In the following, a person detectedby detection processing will be referred to also as a “person to watchout for”.

The reporting processing is processing for reporting a detection resultbased on detection processing. In the reporting processing, for example,an entry into or a stay in the auxiliary warning region or a pass of thewarning line by a person to watch out for is reported. Reporting basedon reporting processing may be executed by the display device 240 or maybe executed by a siren or a warning light.

FIG. 15 is a flowchart illustrating details of setting processing. Instep S211, the control unit 211 displays a setting screen on the displaydevice 240. For more detail, the control unit 211 supplies image datafor displaying the setting screen to the display device 240. The controlunit 211 supplies the image data to the display device 240 via theinterface unit 213.

FIG. 16A and FIG. 16B each are a diagram exemplarily illustrating screentransition of the setting screen displayed in step S211. FIG. 16A is adiagram illustrating one example of the setting screen. A setting screenSC1 includes at least an image captured by the image-capture device 220.Further, the setting screen may include a message such as “input awarning line” for prompting a user to execute inputting. A user inputsthe warning line by using the input device 230. Note that, an imageillustrated in the present example embodiment may include an emphasized,exaggerated, or simplified description in order to make understandingeasy.

In step S212, the control unit 211 acquires coordinates. For moredetail, the control unit 211 acquires input data from the input device230 via the interface unit 213 and thereby acquires coordinates. In theexample of FIG. 16B, coordinates that define the warning line are twoedge points of a line segment that is the warning line.

FIG. 16B is a diagram exemplarily illustrating a warning line L21designated for the image exemplarily illustrated in FIG. 16A. In thisexample, the warning line L21 is a line segment connecting coordinatesP21 and coordinates P22. A user designates coordinates P21 andcoordinates P22 by using the input device 230 and thereby can set thewarning line L21.

In step S213, the control unit 211 calculates coordinates of a positionlocated at a predetermined distance (e.g. 100 meters) from the warningline. In other words, the control unit 211 calculates coordinates of aposition having a fixed distance from the warning line in an actualspace. The control unit 211 calculates coordinates, for example, byfollowing equation (1).R _(dist) =f(P _(a) ,P _(b))  (1)

In equation (1), f(P_(a), P_(b)) is a function for converting a realdistance between coordinates P_(a) and P_(b) on an image (i.e. an actualdistance in a three-dimensional space). Further, R_(dist) represents aconstant equivalent to a predetermined distance. Note that, the functionf(P_(a), P_(b)) can be previously defined by calibration using an imagecaptured by the image-capture device 220. The function f(P_(a), P_(b))is a function of calculating a distance between two coordinates byconverting coordinates P_(a) and P_(b) of a screen coordinate system totwo coordinates of a world coordinate system and is calculable by awell-known technique.

When, for example, coordinates having a real distance of 100 meters fromthe coordinates P21 are determined, the control unit 211 substitutes thecoordinates P21 for P_(a) in equation (1) and calculates P_(b)satisfying R_(dist)=100. Note that, there are a plurality of P_(b) (i.e.coordinates having a real distance of 100 meters from the coordinatesP21) satisfying R_(dist)=100. The control unit 211 executes suchcalculation for all coordinates on an image included in the warning lineL21. The control unit 211 calculates coordinates, for example, asdescribed below.

FIG. 17A is a diagram exemplarily illustrating a curve C1 that is a setof coordinates in which a real distance from the coordinates P21 is anequal distance. In this example, the curve C1 is a closed curveapproximate to a circle around the coordinates P21 but is not a truecircle in a precise sense. In the curve C1, coordinates having a fartherreal distance from the image-capture device 220 have a smaller apparentdistance from the coordinates P21.

FIG. 17B is diagram exemplarily illustrating, in addition to the curveC1, a curve C2 that is a set of coordinates in which a real distancefrom the coordinates P22 is an equal distance. The curve C2 is acircular graphic similar to the curve C1, but an apparent size issmaller than the size of the curve C1. The reason is that thecoordinates P22 is farther than the coordinates P21 in a distance fromthe image-capture device 220. Note that, the control unit 211 calculatesa similar curve for all coordinates included in the warning line L21, inaddition to the coordinates P21 and P22.

FIG. 17C is a diagram exemplarily illustrating a region A1 that is abasis for determining the auxiliary warning region. The region A1 is aset of coordinates P_(a) satisfying R_(dist)≥f(P_(a), P_(b)) whencoordinates P_(b) are any coordinates on the warning line L21. Further,a borderline of the region A1 is a set of coordinates in which a realdistance from the warning line L21 is an equal distance.

When coordinates are calculated in step S213, the control unit 211executes processing of step S214. In step S214, the control unit 211determines the auxiliary warning region based on the coordinatescalculated in step S213. The control unit 211 can determine theauxiliary warning region, for example, by any one of the followingmethods.

The control unit 211 may directly set the region A1 in the example ofFIG. 17C as the auxiliary warning region. This method needs a minimumcalculation amount in comparison with other methods to be describedlater.

Further, the control unit 211 may determine the auxiliary warning regionbased on a direction (orientation) where a person crosses the warningline. This method can be also said to be a method for determining theauxiliary warning line based on a moving direction of a person. Inseveral forms, the moving direction of a person is previously determinedfor the warning line. The moving direction of a person may be set by auser via the setting screen. Alternatively, the moving direction of aperson may be determined based on an actual movement of a persondetected from an image. The moving direction of a person may bepatterned into several typical directions (e.g. two directions).

FIG. 18A and FIG. 18B each are a diagram exemplarily illustrating theauxiliary warning region determined based on the moving direction of aperson. Both auxiliary warning regions A2 and A3 are determined based onthe region A1 of FIG. 17C. The auxiliary warning region A2 is anauxiliary warning region in which the moving direction of a person is adirection of an arrow D1. On the other hand, the auxiliary warningregion A3 is an auxiliary warning region in which the moving directionof a person is a direction of an arrow D2.

In this case, the control unit 211 sets, as the auxiliary warningregion, a remaining region acquired by excluding a region located aheadof the warning line L21 in the region A1 when viewed from a front sideof the moving direction of a person. For more detail, the control unit211 identifies an intersection between a straight line including thewarning line L21 and a borderline of the region A1 and sets, as theauxiliary warning region, any one of regions surrounded by the straightline in the region A1 based on the moving direction of a person.

In this manner, the control unit 211 may determine the auxiliary warningregion according to the moving direction of a person. When, for example,the warning line is set in a place where the moving direction isrestricted to one direction, the control unit 211 may determine theauxiliary warning region as in FIG. 18A and FIG. 18B. In the auxiliarywarning region determined in this manner, a region unnecessary indetection in the region A1 is excluded, and thereby false detection(i.e. unintended detection) of intrusion can be reduced. By doing insuch a manner, a user can use, in intrusion detection, an appropriateauxiliary warning region different depending on the moving direction ofa person.

Further, the control unit 211 may determine the auxiliary warning regionbased on an operation of a user. The control unit 211 may determine theauxiliary warning region, for example, based on coordinates acquired instep S212, i.e. coordinates designated by a user as an edge point of thewarning line. Alternatively, the control unit 211 may determine theauxiliary warning region based on another operation (the movingdirection of a person, coordinates, and the like) that is adetermination reference for the auxiliary warning region.

FIG. 19 is a diagram illustrating another example of the auxiliarywarning region. An auxiliary warning region A4 is determined based onthe region A1 of FIG. 17C. In this example, the control unit 211identifies an intersection between a vertical line to the warning lineL21 crossing an edge point of the warning line L21 and a borderline ofthe region A1 and sets, as the auxiliary warning region, a regionsurrounded by the borderline, the vertical line, and the warning lineL21. The auxiliary warning region determined in this manner can alsoreduce false detection of intrusion similarly to the examples of FIG.18A and FIG. 18B.

Further, the control unit 211 may determine the auxiliary warning regionby using a feature extracted from an image captured by the image-capturedevice 220. The feature referred to here is, for example, an edge or afeature value of Histograms of Oriented Gradients (HOG). The controlunit 211 extracts such a feature from an image captured by theimage-capture device 220, and thereby can determine the auxiliarywarning region based on the extracted feature.

FIG. 20 is a diagram illustrating further another example of theauxiliary warning region. An auxiliary warning region A5 is determinedbased on the region A1 of FIG. 17C. In this example, it is assumed thatthe control unit 211 has detected edges E1 and E2 in a vicinity of thewarning line L21. The edges E1 and E2 each are, for example, a pixelgroup in which a change in brightness of a specific direction in animage is larger than a predetermined threshold. In this case, thecontrol unit 211 determines, as the auxiliary warning region, a regionsurrounded by the warning line L21, the edges E1 and E2, and aborderline of the region A1. The auxiliary warning region determined inthis manner can also reduce false detection of intrusion similarly tothe examples of FIG. 18A, FIG. 18B, and FIG. 19.

Note that, the control unit 211 may be configured to select any one of aplurality of candidates for the auxiliary warning region. In this case,the control unit 211 may display a plurality of candidates for theauxiliary warning region on the display device 240, together with animage captured by the image-capture device 220 and select any one of thecandidates according to an operation of a user. A user confirms, forexample, candidates for the auxiliary warning region displayed by beingoverlapped with the image and selects any desired candidate. At thattime, the control unit 211 may display a plurality of candidatesdifferent in Lust on the display device 240 and cause a user to selectany one of the candidates.

After determining the auxiliary warning region, the control unit 211executes processing of step S215. In step S215, the control unit 211records setting information on the storage unit 212. The settinginformation includes information indicating the warning line andinformation indicating the auxiliary warning region. The settinginformation stored on the storage unit 212 is used in detectionprocessing. The setting information is, for example, coordinatesindicating a border between the warning line and the auxiliary warningregion.

FIG. 21 is a flowchart illustrating details of detection processing(steps S211 to S224) and reporting processing (steps S231 to S232). Thecontrol unit 211 starts executing a series of processing stepsillustrated in FIG. 21 at a timing of starting surveillance based on animage. The start timing of processing by the control unit 211 is, forexample, a timing of starting image-capturing by the image-capturedevice 220 or a timing instructed by a user. The control unit 211executes the following processing for each frame of an image. Note that,for convenience of description, in the following, it is assumed thatthere is one person or less detected in each frame.

In step S221, the control unit 211 determines whether a person has beenrecognized from an image. The control unit 211 can recognize a person bya well-known object recognition technique. The recognition by thecontrol unit 211 may be any one of general object recognition andspecific object recognition. In other words, the control unit 211 mayrecognize an object having a person-like feature or recognize a personhaving a specific feature previously recorded in a database (so-calledblack list). When a person has not been recognized from the image (S221:NO), the control unit 221 ends the processing without executingreporting processing.

When a person has been recognized from the image (S221: YES), thecontrol unit 211 further executes determination of step S222. In stepS222, the control unit 211 determines whether the person recognized instep S221 has entered the auxiliary warning region. At that time, thecontrol unit 211 identifies coordinates of the auxiliary warning regionbased on setting information recorded in setting processing. The controlunit 211 may determine, when at least a part of the person recognized instep S221 is included in the auxiliary warning region, that the personhas entered the region or may determine, when the whole of the person isincluded in the region, that the person has entered the region. When theperson recognized in step S221 does not enter the auxiliary warningregion (S222: NO), the control unit 211 ends the processing withoutexecuting reporting processing.

When the person recognized in step S221 has entered the auxiliarywarning region (S222: YES), the control unit 211 further executesmeasurement processing of step S223. The measurement processing isprocessing of measuring a length of a time period (hereinafter, referredto also as a “detection time period”) in which a certain person is beingdetected in the auxiliary warning region. In step S223, the control unit211 starts measuring the detection time period when the personrecognized in step S221 has not been detected in the auxiliary warningregion in a last frame. On the other hand, the control unit 211 adds thealready-measured detection time period for one frame when the personrecognized in step S221 has been detected in the auxiliary warningregion also in the last frame. Note that, the control unit 211 resetsthe detection time period when in a frame next to a frame where a personhas been detected in the auxiliary warning region, the person is notdetected.

In step S224, the control unit 211 determines whether the personrecognized in step S221 has passed the warning line. When the personrecognized in step S221 has passed the warning line (S224: YES), thecontrol unit 211 executes first reporting processing (step S231).

When the person recognized in step S221 has not passed the warning line(S224: NO), the control unit 211 further executes determination of stepS225. In step S225, the control unit 211 determines whether thedetection time period measured by measurement processing is equal to orlarger than a predetermined threshold. When the detection time period issmaller than the predetermined threshold (S225: NO), the control unit211 ends the processing without executing reporting processing. On theother hand, when the detection time period is equal to or larger thanthe predetermined threshold (S225: YES), the control unit 211 executessecond reporting processing (step S232).

The first reporting processing is processing for displaying a messagethat is, for example, “a person to watch out for has passed a warningline” on the display device 240. In contrast, the second reportingprocessing is processing for displaying a message that is, for example,“a person to watch out for has entered an auxiliary warning region” onthe display device 240. In the second reporting processing, the controlunit 211 may report the measured detection time period together. Notethat, the first reporting processing and the second reporting processingare the same processing.

As described above, according to the intrusion detection system 200 ofthe present example embodiment, setting of the warning line and theauxiliary warning region to detection and reporting of a person can beexecuted. When the warning line and the auxiliary warning region areset, the information processing device 210 enables a user to easily setthe auxiliary warning region (i.e. the setting region), similarly to thesetting assistance device 100 of the fifth example embodiment.

In general, an image in which a three-dimensional space isimage-captured includes positions having different distances (i.e.depths) from the image-capture device 220. Thereby, an image captured bythe image-capture device 220 generates perspective for a viewer (i.e. auser). Therefore, when a certain object is included in such an image,visual perception of the object in the image changes depending on aposition (i.e. a distance from the image-capture device 220) of theobject.

A user may desire to set the auxiliary warning region in a range of anequal distance from the warning line. The auxiliary warning region isfrequently set as “a range at 100 meters from the warning line”, forexample. Especially when an object can enter from any position of aborder of the auxiliary warning region, it can also be said that rangesetting at such an equal distance is reasonable.

However, as described above, an image has depth. Therefore, an apparentdistance in an image and an actual distance (real distance) in athree-dimensional space are not always matched. Therefore, in general,it is difficult for a user to manually input accurately a line such as aborder of the auxiliary warning region.

On the other hand, the warning line is set, for example, at a placewhere people come in and out such as an entrance of a facility (abuilding, a park and the like) to be monitored. Such a place commonlyhas an external appearance discriminable from another place. Forexample, there is a gate at an entrance of a facility or there is noobject (no railing, fence and the like) interfering with traffic ofpeople. Therefore, it is conceivable that work for manually setting thewarning line by a user is relatively easier than work for manuallysetting a region such as the auxiliary warning region.

In the present example embodiment, a user sets only the warning linerelatively easily set manually in this manner and thereby can set theauxiliary warning region relatively difficult to set manually. In theauxiliary warning region determined by the intrusion detection system200, real distances from the warning line have an equal distance, andtherefore, a real distance from the warning line does not become shortdespite an intention of a user. According to such the auxiliary warningregion, even when a person has entered from any position, an entry intoor a stay in the auxiliary warning region can be appropriatelydetermined.

Further, in the present example embodiment, a user can easily modify(edit) the auxiliary warning region to a more preferable shape, asnecessary. Thereby, the intrusion detection system 200 can suppressdetection against an intention of a user. The intrusion detection system200 can reduce a possibility of detecting a person who does not need tobe originally detected.

Modified Examples of Sixth Example Embodiment

The sixth example embodiment is applicable with the followingmodifications.

The warning line is not necessarily a straight line. The warning linemay be, for example, a polygonal line or a curve or may be a combinationof a polygonal line and a curve. Coordinates acquired by the informationprocessing device 210 via the input device 230 is not limited tocoordinates exemplified in the present example embodiment and may besimilar to coordinates acquired by the acquisition unit 110 in the fifthexample embodiment. The information processing device 210 sets a warningline based on coordinates of a polygonal line or a curve acquired viathe input device 230.

FIG. 22 is a diagram exemplarily illustrating the auxiliary warningregion in which the warning line is a curve. In this example, a curve C3represents a set of coordinates in which a real distance from a warningline L31 is an equal distance. The control unit 211 calculates tangentlines T1 and T2 in edge points P31 and P32 of the warning line L31 andsets, as the auxiliary warning region, a region A6 or A7 surrounded bythe warning line L31, the tangent lines T1 and T2, and the curve C3. Thetangent lines T1 and T2 referred to here may be translated as a straightline in which a right-hand derivative or a left-hand derivative in theedge P31 or P32 is a slope.

Further, setting processing may be executed by a device different from adevice for detection processing and reporting processing. In otherwords, the intrusion detection system 200 may include an informationprocessing device that executes setting processing and anotherinformation processing device that executes detection processing andreporting processing. However, a configuration of any one of theinformation processing devices may be similar to the configuration ofthe information processing device 210 of FIG. 13.

The information processing device 210 may detect a plurality of types ofobjects. The information processing device 210 may execute, for example,detection of a person and detection of an automobile at the same time.However, a person and an automobile are different in average movingvelocity. Therefore, when a plurality of types of objects is detected,the information processing device 210 sets R_(dist) in equation (1) tobe different depending on a type of each object. The informationprocessing device 210 may store, for example, a table associating a typeof an object with R_(dist) on the storage 212 and determine theauxiliary warning region based on the type of the object.

Note that, Lust may be specified by a user. Alternatively, a user mayspecify the moving velocity of an object and a desired time period,instead of R_(dist). In this case, the control unit 211 can calculateR_(dist) by multiplying a moving velocity by a time period.

It is unnecessary for the intrusion detection system 200 to detect anobject from an image in real time. In other words, the image referred tohere may be an image previously recorded and stored on a storage and thelike. Further, the information processing device 210 may be located in aremote place separated from another device. The information processingdevice 210 may be realized, for example, using so-called cloud computingtechnology.

The present invention is not limited to the above-described exampleembodiments and various modifications can be made without departing fromthe scope of the invention described in the scope of the claims. It goeswithout saying that these modifications are included in the scope of thepresent invention.

(Supplementary Notes)

A part or the whole of the example embodiments of the present inventioncan be described as, but not limited to, the following supplementarynotes.

(Supplementary Note 1)

A intrusion detection device includes:

a detection unit that detects an intrusion position on an image, theintrusion position being where an object intrudes into a specific regionon the image; and

a control unit that associates the intrusion position on the image witha predetermined time period,

wherein the detection unit outputting an alert when the object stays inthe specific region on the image for the predetermined time period orlonger, the predetermined time period being associated with the detectedintrusion position.

(Supplementary Note 2)

The intrusion detection device according to supplementary note 1,further includes

an input unit that accepts an intrusion position and a predeterminedtime period,

wherein the control unit associates the intrusion position and thepredetermined time period based on the accepted intrusion position andthe accepted predetermined time period.

(Supplementary Note 3)

The intrusion detection device according to supplementary note 1,further includes:

an input unit that accepts an intrusion position,

wherein the control unit sets the predetermined time period based on theaccepted intrusion position.

(Supplementary Note 4)

The intrusion detection device according to supplementary note 1,further includes

an input unit that accepts a predetermined time period,

wherein the control unit sets the specific region based on the acceptedpredetermined time period.

(Supplementary Note 5)

An intrusion detection method includes:

detecting an intrusion position on an image, the intrusion positionbeing where an object intrudes into a specific region on the image;

associating the intrusion position with a predetermined time period; and

outputting an alert when the object stays in the specific region on theimage for the predetermined time period or longer, the predeterminedtime period being associated with the detected intrusion position.

(Supplementary Note 6)

A computer-readable program recording medium recording a program forcausing

a computer to function as:

a detection unit that detects an intrusion position on an image, theintrusion position being where an object intrudes into a specific regionon the image; and

a control unit that associates the intrusion position on the image witha predetermined time period,

wherein the detection unit outputs an alert when the object stays in thespecific region on the image for the predetermined time period orlonger, the predetermined time period being associated with the detectedintrusion position.

(Supplementary Note 7)

A setting assistance device includes:

an acquisition unit that acquires coordinates designated by a user foran image capturing a three-dimensional space;

a calculation unit that calculates coordinates of a position located ata predetermined distance from a position of a part of thethree-dimensional space relating to the acquired coordinates; and

a determination unit that determines a region set for the acquiredcoordinates based on the calculated coordinates.

(Supplementary Note 8)

The setting assistance device according to supplementary note 7, whereinthe determination unit determines the region based on a direction wherean object crosses a position corresponding to the acquired coordinatesin the three-dimensional space.

(Supplementary Note 9)

The setting assistance device according to supplementary note 8, whereinthe determination unit determines the region being different dependingon the direction.

(Supplementary Note 10)

The setting assistance device according to any one of supplementary note7 to supplementary note 9, wherein the determination unit determines theregion by using the acquired coordinates.

(Supplementary Note 11)

The setting assistance device according to any one of supplementary note7 to supplementary note 10, wherein the determination unit determinesthe region by using a feature extracted from the image.

(Supplementary Note 12)

The setting assistance device according to any one of supplementary note7 to supplementary note 11, wherein the determination unit furtherincludes a selection unit that selects any one of a plurality ofcandidates for the region.

(Supplementary note 13)

The setting assistance device according to supplementary note 12,further includes

a display unit that displays the plurality of candidates together withthe image,

wherein the selection unit selects any one of the plurality ofcandidates displayed by the display unit depending on an operation of auser.

(Supplementary Note 14)

The setting assistance device according to any one of supplementary note7 to supplementary note 13, further includes a detection unit thatdetects that an object enters in a part of the three-dimensional spacecorresponding to the determined region.

(Supplementary Note 15)

A setting assistance method includes:

acquiring coordinates designated by a user for an image capturing athree-dimensional space;

calculating coordinates of a position located at a predetermineddistance from a position of a part of the three-dimensional spacerelating to the acquired coordinates; and

determining a region set for the acquired coordinates based on thecalculated coordinates.

(Supplementary Note 16)

A computer-readable program recording medium recording a program forcausing

a computer to execute:

acquiring coordinates designated by a user for an image capturing athree-dimensional space;

calculating coordinates of a position located at a predetermineddistance from a position of a part of the three-dimensional spacerelating to the acquired coordinates; and

determining a region set for the acquired coordinates based on thecalculated coordinates.

REFERENCE SIGNS LIST

-   -   1 Intrusion detection device    -   2 Detection unit    -   3 Control unit    -   4, 5, 6 Input unit

The invention claimed is:
 1. A system comprising: a memory storinginstructions; and at least one processor configured to execute theinstructions to perform: obtaining a warning line and a warning regionset by a user; detecting a person from an image; determining whether thedetected person passes the warning line; reporting a first report basedon determining that the detected person passes the warning line;determining whether the detected person enters the warning region;measuring a length of time in which the person is detected as being inthe warning region, based on determining that the detected person entersthe warning region; determining whether the measured length of time isgreater than or equal to a threshold set for the warning region; andreporting a second report based on determining that the measured lengthof time is greater than or equal to the threshold.
 2. The systemaccording to claim 1, wherein the first report indicates that thedetected person passes the warning line, and the second report indicatesthat the detected person enters the warning region.
 3. The systemaccording to claim 1, wherein the warning line is not a straight line.4. The system according to claim 1, wherein the warning line is formedby a plurality of lines extending in different directions.
 5. The systemaccording to claim 1, wherein the at least one processor is furtherconfigured to execute the instructions to perform: setting an excludedregion, the excluded region being a region that an object is notdetected from the image.
 6. The system according to claim 5, wherein theexcluded region is set to at least a part of the warning region.
 7. Thesystem according to claim 6, wherein the at least one processor isfurther configured to execute the instructions to perform: not detectingthe object in the excluded region from the image.
 8. The systemaccording to claim 5, wherein the at least one processor is furtherconfigured to execute the instructions to perform: detecting a pluralityof types of objects from the image.
 9. A method comprising: by at leastone processor, obtaining a warning line and a warning region set by auser; detecting a person from an image; determining whether the detectedperson passes the warning line; reporting a first report based ondetermining that the detected person passes the warning line;determining whether the detected person enters the warning region;measuring a length of time in which the person is detected as being inthe warning region, based on determining that the detected person entersthe warning region; determining whether the measured length of time isgreater than or equal to a threshold set for the warning region; andreporting a second report based on determining that the measured lengthof time is greater than or equal to the threshold.
 10. The methodaccording to claim 9, wherein the first report indicates that thedetected person passes the warning line, and the second report indicatesthat the detected person enters the warning region.
 11. The methodaccording to claim 9, wherein the warning line is not a straight line.12. The method according to claim 9, wherein the warning line is formedby a plurality of lines extending in different directions.
 13. Anon-transitory computer-readable medium storing thereon instructionsexecutable by at least one processor to cause the at least one processorto perform a method comprising: obtaining a warning line and a warningregion set by a user; detecting a person from an image; determiningwhether the detected person passes the warning line; reporting a firstreport based on determining that the detected person passes the warningline; determining whether the detected person enters the warning region;measuring a length of time in which the person is detected as being inthe warning region, based on determining that the detected person entersthe warning region; determining whether the measured length of time isgreater than or equal to a threshold set for the warning region; andreporting a second report based on determining that the measured lengthof time is greater than or equal to the threshold.
 14. Thenon-transitory computer-readable medium according to claim 13, whereinthe first report indicates that the detected person passes the warningline, and the second report indicates that the detected person entersthe warning region.
 15. The non-transitory computer-readable mediumaccording to claim 13, wherein the warning line is not a straight line.16. The non-transitory computer-readable medium according to claim 13,wherein the warning line is formed by a plurality of lines extending indifferent directions.